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Abstract — We derive the capacity region of arbitrarily varying 
multiple-access channels with conferencing encoders for both 
deterministic and random coding. For a complete description it 
is sufficient that one conferencing capacity is positive. We obtain 
a dichotomy: either the channel's deterministic capacity region 
is zero or it equals the two-dimensional random coding region. 
We determine exactly when either case holds. We also discuss 
the benefits of conferencing. We give the example of an AV-MAC 
which does not achieve any non-zero rate pair without encoder 
cooperation, but the two-dimensional random coding capacity 
region if conferencing is possible. Unlike compound multiple- 
access channels, arbitrarily varying multiple-access channels may 
exhibit a discontinuous increase of the capacity region when 
conferencing in at least one direction is enabled. 

Index Terms — Base station cooperation, Channel uncertainty. 
Compound channels. Arbitrarily Varying Channels, Conferenc- 
ing Encoders. 



I. Introduction 

Multiple-Access Channels (MACs) and similar multi-sender 
channels with conferencing encoders have attracted attention 
recently due to the inclusion of base-station cooperation meth- 
ods in standards for future wireless systems [6], [13], [15], 
[18]. The original conferencing protocol for the discrete mem- 
ory less MAC is due to Willems [19], [20]. The conferencing 
MAC with imperfect channel state information was modeled as 
a compound MAC with conferencing encoders and considered 
in [17], a different model for channel state uncertainty is given 
in [14]. 

This paper covers a very high degree of channel uncertainty 
in MACs: the channel states may vary arbitrarily over time. 
The task is to use coding to enable reliable communication for 
every possible state sequence. The corresponding information- 
theoretic channel model is the Arbitrarily Varying MAC (AV- 
MAC). The random coding capacity region of the AV-MAC 
without encoder cooperation was determined in [12]. Building 
on this result, the deterministic coding capacity region of 
some AV-MACs without cooperation was determined in [4]. 
In general, it is still open. We will use the "robustification" 
and "elimination of correlation" techniques developed by 
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Ahlswede in [1], [2], and partly already used in [12] in a multi- 
user setting, in order to characterize both the deterministic 
and random coding capacity regions of any AV-MAC with 
conferencing encoders, i.e. of any AV-MAC where encoding 
is done using a Willems conference as in [19], [20] with at 
least one positive conferencing capacity. Thus none of the 
techniques we apply in this paper is completely new, but in 
contrast to the non-conferencing situation, they allow for the 
complete solution of the problems considered here. The rather 
general "robustification" technique establishes the random 
coding capacity region of the AV-MAC with conferencing 
encoders. Both single- and multi-user arbitrarily varying chan- 
nels are special in that random coding as commonly used 
in information theory does not yield the same results as 
deterministic coding. This shows that common randomness 
shared at the senders and the receiver is an important additional 
resource. There is a dichotomy: either reliable communication 
at any non-zero rate pair is impossible with the application 
of deterministic codes, or the deterministic capacity region 
coincides with the random coding capacity region, which then 
is two-dimensional. In the latter case, one needs the non- 
standard "elimination of correlation" [1] for derandomization. 
It is a two-step protocol which achieves the random coding 
capacity region if this is possible. 

The combination of the elimination technique with confer- 
encing proves to be very fruitful. Here lies the main difference 
between the AV-MAC with and without conferencing. One 
can show that there exist channels which only achieve the 
zero rate pair without transmitter cooperation, but where 
derandomization using the elimination technique is possible 
if the transmitters may have a conference. The reason for 
this is symmetrizability. This can be interpreted in terms 
of an adversary knowing the channel input symbols and 
randomizing over the channel states. There are three kinds 
of symmetrizability for multiple-access channels. The capacity 
region of the AV-MAC without conferencing equals {(0,0)} if 
all three symmetrizability conditions are satisfied. In contrast, 
the elimination of correlation technique works if the AV- 
MAC with Willems conferencing encoders does not satisfy the 
conditions for the first of the three kinds of symmetrizabilities. 
The two others do not matter By conferencing with at least 
one positive conferencing capacity, the AV-MAC gets closer 
to a single-sender arbitrarily varying channel where only one 
symmetrizability condition exists [8]. This induced change of 
the channel structure is also reflected in the counter-intuitive 
fact that conferencing with rates tending to zero in blocklength 
can enlarge the capacity region. The adversary interpretation 
of symmetrizability highlights the importance of the AV- 
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MAC for the theory of information-theoretic secrecy: if a 
channel is symmetrizable, an adversary can completely prevent 
communication . 

The paper is organized as follows: the next section is 
devoted to the formalization of the channel model and the 
coding problems. We present the main theorems and several 
auxiliary coding results. The direct parts of the random and 
deterministic coding theorems are solved in Section III. Sec- 
tion rV gives the converses of the random and deterministic 
AV-MAC coding theorems. Section V concludes the paper 
with a discussion. In particular, the gains of conferencing are 
analyzed there. 

Notation: In the information-theoretic setting, we also use 
the terms "encoders" for the senders and "decoder" for the 
receiver. For any positive integer m, we write for the 

set {1, . . . , m}. For a set A c we denote its complement 
by A'^ := \ A. For real numbers x and y, we set a; A y := 
mm{x,y) and xVy := max{a;,y}. denotes the set of 

probability measures on the discrete set 

II. Problem Setting 

A. The Main Coding Problems 

Let ^ be finite alphabets, let be another finite 

set. For every s & S^, let a stochastic matrix 

W{z\x, y\s): {x,y, z) e ^ x x ST 

be given with inputs from xW and outputs from ^ . 5^ 
is to be interpreted as the set of channel states. We set 

We assume that the channel state varies arbitrarily from chan- 
nel use to channel use. Given words x = (xi, . . . , x„) G 
y - {yx,...,yn) e and z = G the 

probability that z is received upon transmission of x and y 
depends on the sequence s G of channel states attained 
during the transmission. It equals 

n 

T4^"(z|x,y|s) := JJ W{zm\x^,y,n\sjn)- (1) 

m— 1 

Definition 1. The set of stochastic matrices 

{W^"(-|-,-|s):sG^",n=l,2,...} 

is called the Arbitrarily Varying Multiple Access Channel (ASf- 
MAC) determined by W. 

In the traditional non-cooperative encoding schemes used 
for multiple-access channels, none of the senders has any 
information about the other sender's message. The goal here is 
to characterize the capacity region of the AV-MAC achievable 
when limited information can be exchanged between the 
encoders. We use Willems conferencing for this exchange [19], 
[20J. If the encoders' message sets are [l,Mi] and [1,M2], 
respectively, then this can be described as follows. Let positive 
integers Vi and V2 be given which can be written as products 



for some positive integer I which does not depend on u. A pair 
(ci, C2) of WiUems conferencing functions is determined in an 
iterative manner via sequences of functions ci 1, . . . , cu and 
C2.1, • • • , C2,/. The function ci i describes what encoder 1 tells 
the other encoder in the i-th conferencing iteration given the 
knowledge accumulated so far at encoder 1. Thus in general, 
using the notation 

fl ifi/ = 2, 
1/ := < 

[2 ifu=l, 

these functions satisfy for = 1, 2 and i = 2, . . . ,1 

c,,i : [1,M,] -> [l,K,i], 

c,,i : [1, M,] X [1, V,,i] X ... X [1, -> [1, 

These functions recursively define other functions 

c;i:[l,M,]^[l,K,i], 

:[l,Mi]x[l,M2]->[l,K,i] 

by 

= Cl,l{j), 

= ci,,(j, c;_i(fc),...,C2_i_i(i,A;)), 

C2,iU,k) = C2,i(A;,ct_i(j),...,ct_j_i(j, k)). 

Then we set 

Cu{j,k) := {{cl^i{j,k),...,ctj{j,k)). 

Observe that given a message pair (j, k), the conferencing 
outcome {ci{j.k),C2{j,k)) is known at both transmitters. If 
all conferencing protocols were allowed, the encoders could 
inform each other precisely about their messages, so this 
would turn the MAC into a single-sender channel. Thus for 
nonnegative numbers Ci,C2, if conferencing is used in a 
blocklength-n code, WiUems introduces the restrictions 

-logK<a. (2) 
n 

Ci,C2 are called the conferencing capacities. Having intro- 
duced Willems conferencing, we can now define the codes we 
are going to consider. 

Definition 2. 1) Let n,Mi,M2 be positive 
integers and Ci , C2 > 0. A deterministic 

codecoNF {n, Mi , M2 , Ci , C2 ) with blocklength n, 
codelength pair (Mi,M2), and conferencing capacities 
Ci,C2 is given by functions ci, C2, /i, /2, ^. Here, 
(ci,C2) is a Willems conferencing protocol satisfying 
(2). /i,/2 are the encoding functions 

h:[l,Mi]x[l,V2]^ 
/2:[l,M2]x[l,l/i]^jr". 

The decoding function $ is a function 

$ : iT" ^ [l,Mi] X [1,M2]. 

2) A random code coNpin, Mi, M2,C 1,02) with block- 
length n, codelength pair (Mi,M2), and conferenc- 
ing capacities Ci,C2 is a pair {C,G), where C = 
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Fig. 1. The AV-MAC if with conferencing encoders. 



Then for any s G define 



(6) 

to be the average error incurred by C(j) under channel 
conditions s. Assume that G has distribution pc- We 
say that the random codecoNF defined by (C, G) has an 
average error smaller than A G (0, 1) if 



{C(7) : 7 G r} is a finite family of deterministic 
codescoNF(^^, -Ml, -^2, Ci, C'2), and where G is a ran- 
dom variable taking values in F. 

Note that a codecoNF('T^, -^1,-^2, 0, 0) is a traditional MAC 
code without conferencing. An AV-MAC together with the 
above coding procedure is called an AV-MAC with confer- 
encing encoders, see Fig. 1. A codecoNF Afi, ^^2, Ci, C2) 
defined by (ci, C2, /i, /2, 4") gives rise to a family 

{(x,fe, yjfc, Fjfc) : (i, k) G [1, Ml] x [1, M2]}, (3) 

where 

x,-fc :=/i(j,C2(i,fc)) G JT", 
y.fc :=/2(fc,ci(j,fc)) G^T", 
F,, :-<I)-i{0-,fc)}cir". 

If the message pair (j, fc) is present at the senders, the 
codewords xji- and y^-fe are sent. The decoding sets {Fjk : 
(j, fc) G [1, Ml] X [1, M2]} give a partition of which, just 
like assigns to every channel output z G a message 
pair which the receiver will decide for upon reception of z. 

Note that every family (3), where the Fjk are disjoint, to- 
gether with a Willems conferencing protocol (ci , C2) satisfying 

(2) defines a codecoNF('^, Mi, M2, Ci, C2) if 

Xjfe = Xjk' if C2(j, k) = C2{j, k'), (4) 
Yjk = Yj'k if ci(j, k) = ci{j', k). (5) 

Thus a codecoNF can equivalently be defined by a family 

(3) together with a conferencing protocol [01,02) such that 

(4) and (5) are satisfied. We will often refer to a codecoNF 
using the description (3), and usually without specifying the 
corresponding conferencing protocol by just assuming that 
there is one. 

The first example of this convention is encountered in our 
definition of the average error, where the explicit form of the 
conferencing protocol is irrelevant. 

Definitions. 1) A codecoNF(?i, Mi, M2, Ci, C2) defining 
a family (3) has an average error probability less than 
A G (0, 1) if 

W^iF^k |x,fe, y,fc |s) < A for all s G 

2) Let a random codecoNFlJ^, Mi, M2, Ci, C2) with the 
form {C,G) be given. Assume that the deterministic 
codecoNF C(7) has the form 

{{^]u,y]k^F],):{j,k)e[l,Mi]x[l,M2]}. 



Pe(C(7)|s)pG(7) < A for every s G y^. 

7er 

This means that uniformly for every interfering sequence, 
transmission using this code is reliable up to the average error 
level A. The possible state sequences are not weighted by any 
probability measure. One can interpret this in a communication 
setting with an adversary who knows which words x, y are 
input into the channel by the senders and then can choose any 
state sequence s G in order to obstruct the transmission 
of X and y. The goal of the encoders then is to enable reUable 
communication no matter what sequence s the bad guy might 
use. 

The concept of achievabihty of a rate pair is the usual 
one except that conferencing codescoNF are allowed for code 
construction. 

Definition 4. A rate pair (i?i,i?2) is achievable by the AV- 
MAC with conferencing encoders and conferencing capacities 
Ci,C2 under deterministic/random coding if for every A G 
(0, 1) and for every e > 0, for n sufficiently large, there is a 
deterministic/random codecoNF('^, Mi , M2, Ci , C2) with 

^logM^>i?^-e (i/ = l,2), 

and with an average error smaller than A. The set of achiev- 
able rates under deterministic/random coding is called the 
deterministic/random capacity region of the AV-MAC with 
conferencing encoders and conferencing capacities Ci,C2 
and denoted by %(=5^, Ci, C2) (for deterministic coding) and 
'^ri'^-i Ci,C2) (for random coding). 

We can now formulate the coding problems which are at 
the center of this work: 

Characterize the deterministic/random capacity regions 

C'l, C2) and %{.9', Ci, C2) of the AV-MAC with 
conferencing capacities C'l , C2. 

Of course, the main focus is on the deterministic ca- 
pacity region Ci,C2) as the random capacity re- 
gion '«fr('^, C'l, C2) requires common randomness shared at 
the encoders and the receiver. For both C'l, C2) and 
^r{'$^, C'l, C2), we need to consider the convex hull of W. 
It is parametrized by the set of probability distributions ^(^) 
on y, so one can regard 3^{y) as its "state space". The 
stochastic matrix from W assigned to the "state" q G ^{y) 
is the matrix with inputs from ^ x ^ and outputs from 3f 
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having the form 

W{z\x,y\q) := ^ W{z\x,y\s)q{s), 

{x,y,z) e .r X ?^ X iT. 

We have W C W hy identifying s e ,y with the Dirac 
measure G ^{y), so that • | • , • |s) = W( • | • , • l^^). 

Next we define a set of rates Ci, C2). Let 11 be the 

set consisting of probability distributions p € x ^ x 

where ranges over the finite subsets of the integers and 
where p has the form 

p{u,x,y) = po{u)pi{x\u)p2{y\u). 

To each p e 11 and q G ^{J^) one can associate a generic 
random vector {U, X, Y, Zg) with distribution 

Pg{u, X, y, z) = p{u, x, y)W{z\x, y\q). (7) 

In this way every p e 11 and q G ^{y) define a set 
^{p, q, Ci, C2) consisting of those pairs i?2) of nonneg- 
ative real numbers which satisfy 

Ri<I{Zg;X\Y,U) + Cu 

R2<I{Zg;Y\X, U) + C2, 
Ri+R2< {I{Zg; X, Y\U) + Ci+ C2) A I{Zg- X, Y). 
Then set 

■^*(^,Ci,C2) := U fl ^{p,q,C,,C2). 

pen qe^(y) 

Theorem 5. For the AV-MAC determined by W with confer- 
encing capacities Ci , C2 > 0, we have 

%{y,Ci,C2) = ^*{y,CuC2). 

More precisely, for every (i?i,i?2) G '^f*(c5^, Ci, C2) and 
every £ > there is a C, > Q and a sequence {Cn,Gn) of 
random codescoH¥{n,M^\M!^\Ci,C2) with an average 
error at most 2""^ such that 

Additionally the {Cn,Gn) can be chosen such that for every 

n, the constituent deterministic codesconv share the same non- 
iterative Willems conferencing protocol (c^"^ , Cg""* ) given by 

4") : [1,M(")] ^ [l,yj")] (1^ = 1,2). (8) 

Remark 1. The simple form (8) of conferencing means that 
no complicated conferencing protocol needs to be designed. 

Remark 2. '^*{y, Ci, C2) was analyzed in [17]. It is convex 
and the auxiliary sets can be restricted to have cardinality at 
most (|^||^|+2)A(|^|+3). Moreover, one can determine 
finite Ci , C2 such that 

1) the full-cooperation sum rate, or 

2) the full-cooperation capacity region 

are achievable. The first statement can be phrased as 

max imn^^{{I{Zg; X,Y\U) + Ci + C2) A I{Zg- X, Y)} 

= max min I(Za; X,Y) =: Coo- 
pen ge^(J^) 



If for p e n we set := {q G ^{y) : I{Zg AX,Y) = 
Coo}, then a simple calculation shows that the above condition 
is satisfied if 

Ci + C2 > Coo - min max I(Z A X, Y\U). 
pen qe^p 

Statement 2) is valid if both Ri = Coo and R2 = Coo are 
possible. For this one needs 

Ci > Coo - max min /(Z„ A X\Y, U), 
pen qeBp 

C2 > Coo - max min IiZ„ A Y\X, U). 
pen ge^p 

Remark 3. Theorem 5 has a weak converse. 

Determining the general deterministic capacity region 
%(^, Ci,C2) is more complex. We give the solution in 
Theorem 7 below for Ci VC2 > 0. For Ci = C2 = a partial 
solution is given in [12],[1 1],[10],[4]. The relation between 
the cases Ci = C2 = and Ci V C2 > is discussed in detail 
in Section V. 

Definition 6 ([11]). 1) W is called (^,^)- 
symmetrizable if there is a stochastic matrix 

a{s\x,y): {x,y, s) e ^ x '3^ x y 

such that for every z £ 2f and x,x' £ ^ and y, y' G 

^W{z\x, y\s)a{s\x',y') = ^W{z\x', y'\s)a{s\x, y). 

s s 

2) W is called ^ -symmetrizable if there is a stochastic 
matrix 

ai{s\x): {x,s)G^xy 
such that for every z £ 3f and x,x' € ^ and y G 
Y,Wiz\x,y\s)ai{s\x') = W^(z|a;', 

s s 

3) W is called ^ -symmetrizable if there is a stochastic 
matrix 

<^2{s\y): {y,s)&Wxy 
such that for every z €: 3f and x & 3^ and y, y' G '¥ , 

^^'W{z\x,y\s)(j2{s\y') = Y,W{z\x,y'\s)o2{s\y). 

s s 

Theorem 7. For the deterministic capacity region of the AV- 
MAC determined by W with conferencing capacities Ci V 
C2 > 0, we have 

%(J^,Ci,C2)=<r*(^,Ci,C2) 

if W is not [Sy ,'y)-symmetrizable and 

'^d{y,CuC2) = {{QM 

if W is {.T ,W)-symmetriz.able. As for %.[y ,Cx,C2), the 
'Willems conferencing protocols can be assumed to have the 
simple non-iterative form (8). 

Remark \. M W \s, not ^)-symmetrizable, then 
^ed^y, Ci, C2) = '€*{y, Ci, C2) is at least one-dimensional. 
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As Ci V C2 > 0, in order to show this it clearly suffices to 
check that 

max min I(Z„;X,Y)>0 (9) 

pen qe.^{.y) 

\i W Ss, not symmetrizable. If (9) were violated, then by [7, 
Lemma 1.3.2] there would be a e ,^(^) such that 

W{z\x,y\q)^W{z\x',y'\q) 

for all x,x' G SC.y^y' G '¥ ,z G ^. Thus W would be 
^)- symmetrizable using the stochastic matrix 

But this would contradict our assumption, so (9) must hold. 

Remark 5. One can regard symmetrizability as the single- 
letterization of the adversary interpretation of the AV-MAC 
given above. There, a complete input word pair has to be 
known to the adversary who can then choose the state se- 
quence. In the definition of ^^)-symmetrizability, the 
stochastic matrix cr : ^ — > =5^ means that given a letter 
X G the adversary chooses a random state s G S^. If 
is ^^)-symmetrizable, the adversary can thus produce a 
useless single-state MAC : (JT x ^Vf ^ defined by 



W{z\x,y,x',y') 



^W{z\x,y\s)a{s\x',y'). 



W is useless because it is symmetric in {x,y) and {x',y'). 
Thus for word pairs (x, y) and (x',y'), the receiver cannot 
decide which of the pairs was input into the channel by the 
senders and which was induced by the adversary's random 
state choice. 

Remark 6. The above adversary interpretation of symmetriz- 
ability makes AV-MACs relevant for information-theoretic 
secrecy. Clearly, we do not say anything about the decodability 
of communication taking place in an AV-MAC for non- 
legitimate listeners. However, reliable communication can be 
completely prevented in the case the AV-MAC is symmetriz- 
able. A discussion of the single-sender arbitrarily varying 
wiretap channel can be found in [5]. 

Remark 7. By the definition of Willems conferencing, setting 
Ci = C2 = yields the traditional MAC coding, i.e. no 
conferencing at all is allowed. An inspection of the ehmination 
technique applied in III-D shows that actually it suffices to 
have conferencing with Vi = n^, so Ci = (2 log n)/n (or, 
by symmetry, V2 = n^). Using conferencing with this non- 
constant rate tending to zero in non-(^, ^)- symmetrizable 
AV-MACs yields the capacity region 0, 0). 

Remark 8. If W is ^?^)-symmetrizable, then Theorem 7 
almost has a strong converse: it is possible to show that every 
code that encodes more than one message incurs an average 
error at least 1/4. If W is not $^)-synmietrizable, then 
we have a weak converse. 

Theorem 7 does not carry over to the case Ci = C2 = 0, 
which is the traditional AV-MAC with non-cooperative coding. 
To our knowledge, the full characterization of the deterministic 
capacity region %(,y,0, 0) of the AV-MAC without cooper- 
ation is still open. We summarize here what has been found 



out in [4], [10], [11], and [12]. For notation, observe that 

max inf I(Za;X\Y,U) 

pen qe&'iJ^) 

= max inf /(Z„;X|y) 
pen qe^{J^) 

= max max inf I(Za;X\Y = y), 

where in the last term, the random vector {X, Zg) has the 
distribution r{x)W{z\x,y\q). 

Theorem 8. 1) // W is neither (S", ^)- nor 3C- nor ^- 
symmetrizable, then %(^, 0,0) = '^*(^, 0,0) and 
0,0) has nonempty interior 

2) IfW is neither , ^)- nor ^ -symmetrizable, but W - 
symmetrizable, then 

%(^,0,0) 

C [0,max max inf I{Za\X\Y = y)] x 

3) IfW is neither , ^)- nor 'W -symmetrizable, but ^- 
symmetrizable, then 

%(^,0,0) 

C {0} X [0,max max inf I(Zg;Y\X = x)]. 

4) IfW is {^,^)-symmetrizable, then %(Ji^,0,0) = 
{(0,0)}. 

In particular if W is both and ^ -symmetrizable, then 
%(^,0,0) = {(0,0)}. 

Remark 9. 1) from Theorem 8 is due to [4] and [12]. The 
other points are due to [10], [11]. The precise characterization 
of %(^, 0, 0) in points 2) and 3) is still open. 

Remark 10. The relation between the three kinds of sym- 
metrizabihty from Definition 6 is treated in Section V. There 
we provide the example of an AV-MAC which is both S(J- 
and ^-symmetrizable but not ^)-symmetrizable. 



B. Related Coding Results 

The set W also determines a compound MAC. This channel 
differs from the AV-MAC in that it does not change its state 
during the transmission of a codeword, only constant state 
sequences are possible. Thus the probabihty that z G is 
received given the transmission of words x G JT", y g 
only depends on the given state q G ■^(■5^). It equals 

n 

l^"(z|x,y|qg) := [] W{zm\xm,ym\q), (10) 

where we denote elements of ^(J^)" by q and set := 
(g,...,g)G^(^)". 

Definition 9. The set of stochastic matrices 

{W"(-|-,-|q,):gG^(=5^),n = l,2,...} 

is called the compound Multiple Access Channel (compound 
MAC) determined by W. 
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One uses the same deterministic codescoNF as for the AV- 
MAC. Let 

{(x,fc,y,fc,F,fc) : {j,k) e [l,Mi] x [1,M2]} 

be such a codecoNF- It has an average error less than A for the 
compound MAC determined by W if 

for every q G 3^ {^5^). Using this average error criterion, the 
concept of achievabihty and the definition of the capacity 
region is analogous to that for deterministic coding for AV- 
MACs. 

Remark 11. Comparing the error criteria for the AV-MAC 
and the compound MAC from the adversary perspective, one 
observes that the AV-MAC yields a significantly more robust 
performance. Theorem 7 describes the region achievable if 
transmission is reliable for every possible sequence the adver- 
sary might choose, whereas Theorem 10 describes the region 
which is achievable if the adversary is restricted to constant 
state sequences. 

In [17] the following theorem was proved. 

Theorem 10. The capacity region of the compound MAC 
determined by W with conferencing capacities Ci,C2 > 
equals '^*(,5^, Ci, C2). More precisely, for every achievable 
rate pair (i?i , i?2) G [y, Ci , C2) and every e > 0, there is 
a C > and a sequence ofcodescoNF {n, m["'\ M2"\ Ci, C2) 
with an average error at most 2~"'> and 

-logM^") >i?, -£ (1^ = 1,2). 
n 

These codescoNF can be chosen such that their conferencing 
protocols have the form (8). 

Finally we have to recall the definition and a corollary of the 
deterministic coding result for single-user Arbitrarily Varying 

Channels (AVCs). Let jz/ be a finite input alphabet, a finite 
output alphabet, and a finite state set. Let a family 

■.= {H{- \ ■ \s) :s&y)} 

of stochastic matrices 

H{h\a\s): {a,b)e£/x.^ 

be given. As for AV-MACs, every state sequence s = 
(si, . . . , s„) e cS^" determines a new stochastic matrix 

n 

if"(b|a|s) := II H{bm\am\sm) : (a, b) e ^" x 

m=l 

Definition 11. The set of stochastic matrices 

{H"{-\ ■ |s):sG^",n=l,2,...} 
is called the Arbitrarily Varying Channel (AVC) determined by 

The admissible codes are classical single-user codes as 
used for discrete memoryless channels. If such a code with 
blocklength n and codelength M has the form 

{(a,,i?»:£e[l,M]}, 



then the average error incurred by this code is smaller than 

A e (0, 1) if 

if"(F/|a^|s) < A for all s e 

Then it is obvious what is meant by "achievable rates" and 
"capacity" for J^. The capacity of single-user AVCs, which 
was determined in [8], exhibits a dichotomy similar to the 
one claimed in Theorem 7. It is described by the original 
symmetrizability concept from [9]. 

Definition 12. M' is called symmetrizable if there is a stochas- 
tic matrix 

a{s\a) : (a, s) G ^ X ^ 
such that for every h <^ SS and a, a' G 

^iJ(&|a|s)a(s|a') = ^ i?(5|a'|s)a(s|a). 

s s 

Remark 12. Clearly, the (j^T, ^^)-symmetrizability of the 
MAC W means nothing but symmetrizabihty of W when 
considered as a set of stochastic matrices with inputs from 
the alphabet ^ = JT x ^. 

Theorem 13 ([8], Theorem 1). The deterministic capacity of 
the single-user AVC determined by Jif is positive if and only 
if M' is not symmetrizable. If ^ is symmetrizable, then every 
code with at least two codewords incurs an average error at 
least 1/4. 

III. The Direct Parts 

We derive the direct part of Theorem 5 from Theorem 10 
in Subsections III-A and III-B. Then, if W is not (JT,^)- 
synometrizable, we derandomize in Subsections III-C and III-D 
to obtain the direct part of Theorem 7. 

A. From Compound to Arbitrarily Varying 

Here we prove the direct part of Theorem 5. We use 

Ahlswede's "robustification lemma". Let S'„ be the symmetric 
group (the group of permutations) on the set [1, n]. 5„ operates 
on 6^'^ by 7r(s) := (s,r(i), • • • , S7r(n)) for any tt G S'n and 
s = (si , . . . , s„) G Further recall the notation defined 
in (10). 

Lemma 14 ([3], Lemma RT). ///i : J?^" [0, 1] satisfies for 
a A G (0, 1) and for all q G the inequality 

5^ /i(s)qg(s) > 1 - A, (11) 

then it also satisfies the inequality 

V hMs)) >l-{n + 1)1-^^ for all s G 

Now let i?2) G Ci, C2). Theorem 10 states that 

for any s > there is a ^ > such that for sufficiently large n 
there is a codecoNF('T^, Mi,M2, Ci, C2) with an average error 
at most 2~"'» and satisfying 

-\ogM^>R^-e {y = l,2). 
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Writing this codecoNF in the form (3), this means for every 
g e ^(^) that 

^^^Y,w^iFjk\^jk,yM > 1 - 2-"^- (12) 

We would like to apply Lemma 14 with A = 2""'' to the 
function h : ^ ^ [0, 1] defined by 

^^^^ ^= Mi^E^"(^:''^l^^'^'y^-fcl«)- 



Thus we need to show that h satisfies (11). Let q G ^(=5^). 
By (12), one obtains 



j.k zeF,fc sGJ^" 

> 1 - 2-"f 



and (11) is satisfied. Applying Lenmia 14, one obtains 

E ^('^(s)) > 1 - + 1)1-^12-"^ for all s e =5^". 



(13) 



Recall that tt ^ also is an element of Sn- Writing tt ^ (^jfe) 
{7r~^(z) : z G -Fjfc}, the left side of (13) equals 

;^E(i^E^"(^.-K-y.-w«))) 



n! 5 (miMs^ 



x^l^"(7r-i(i?,fe)k-'(x,fc),7r-i(y,fe)|s) . (14) 
j,k ^ 

Because of the bijectivity of tt"^, the family of sets 
{TT^H^jfe) : Ufc) e [l,Mi] X [1,M2]} is disjoint. Thus (14) 
is the average error expression of the random code (C, G) 
when applied in the AV-MAC determined by W, where G is 
uniformly distributed on r : — Sji and where for every tt G Sji^ 

C(7r) := {(7r-i(x,fc),7r-i(y,fe),7r-i(F,-fe)) : 

(i,fc)e[l,Mi]x[l,M2]}. 

The conferencing protocol remains the same for every C(7r), 
as the conference only concems the messages and not the 
codewords. By (13) the average error of this random code is 
less than (n + 1)''^'2~"'», hence it tends to zero exponentially. 
Thus 'r*(^,Ci,C2) C '^r(^,Ci,C2), which proves the 
direct part of Theorem 5. 

B. Bounding the amount of correlation 

As a first derandomization step to proving the direct part of 
Theorem 7, we have to show the following lemma. 



Lemma 15. To every random codeQ,Q^{n,M.\^Mi^C\^C-i) 
with average error at most A which is given as a pair (C, G) 
there exists a random codecoNF{n,Mi,M2,Ci,C2) with an 
average error smaller than 3A given as a pair (C , G') where 
G' C C and \G'\ = and where G' is uniformly distributed 
on [l,n^]. 

For the proof of Lemma 15, we need a simple result from 
[12, Section IV]. 

Lemma 16. Let N i.i.d. random variables Ti,...,Tjv with 
values in [0, 1] and underlying probability measure P be given. 
Let A > 0. Denote by E the expectation corresponding to P. 
Then 



1 ^ 

si:/' 



> A 



< exp (-(A - eE[Ti])A^) 



Proof of Lemma 15: Let a random codecoNF {G, G) with 
blocklength n and average error smaller than A. Recalling our 
notation (6), the fact that (G, G) has an average error less than 
A can be stated as 

E[Pe(C(G)|s)] < A for every s e 

Let Gi,...,G„2 be independent copies of G. This induces 
a family of independent copies of (G, G). The goal is to 
show 



1 " 

— E Pe{G{Gm)\s) < 3A for all s e ^" 



m=l 



>0. (15) 



Given (15), there is a realization (7i,...,7„2) of 
(Gi , . . . , G„2 ) such that 



1 " 

-E^'e(G(7™)|s)<3A 



(16) 



m=l 



for every s € J^". Then one defines a random code (G', G') 
by setting 

C" := {G(7™):me[l,n2]} 

and by taking G' to be uniformly distributed on [l,n^]. The 
expression (16) then is nothing but the statement that the 
average error of the random code (G', G') is smaller than 3A, 
and we are done. 

It remains to prove (15). is finite by assumption, so 
|yn| gj-Q^g exponentially with blocklength. Hence it suffices 
to show that 



\y^P,{G{GM>^X 



(17) 



is superexponentially small uniformly in s £ Let us fix 
an s € c5^". The Gm are i.i.d. copies of G, so by Lemma 16, 
the term (17) is smaller than 



exp(- (3A - eE[Pe(G(G)|s)]) n^). 
By assumption 

E[Pe(C(G)|s)] < A, 



(18) 



so the exponent in (18) is negative. This gives the desired 
superexponential bound on (17). ■ 
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Remark 13. Note that we cannot require the codescoNF with at 
most values of G to have an exponentially small probability 
of error. This is due to the fact that the exponent in (18) must 
not decrease exponentially in order for the proof to work. 
Thus there is a trade-off between the error probabihty and the 
number of deterministic component codescoNF of the random 
codescoNF used to achieve the random capacity region of the 
AV-MAC with conferencing encoders. 

C. A Positive Rate 

In the second derandomization step, we show that if W 
is not S^)-symmetrizable and Ci > or C2 > then 
the encoder with the positive conferencing capacity achieves 
a positive rate by deterministic coding. Without loss of gen- 
erality we may assume that Ci > 0. 

Theorem 17. Let Ci >O.IfW is not W)-symmetrizable, 
then there exists an R with Q < R < C\ such that the rate 
pair (i?, 0) G '?f*(cS^, Ci, C2) is deterministically achievable 
using codescoNF with conferencing capacity pair (Ci, 0) such 
that the conferencing function ci is the identity on the message 
set 

Proof: By Remark 12 and Theorem 13, W considered 
as a single-user AVC with vector inputs from the alphabet 

y, W has positive capacity. The idea of the proof is to 
construct from a code for this single-user AVC a codecoNF 
such that the first transmitter achieves a positive rate. There is 
a positive rate R < C\ which is deterministically achievable 
by the single-user AVC determined by W . This means that for 
every A e (0, 1) and every e > 0, for n large enough, there is 
a single-user code 



with blocklength m, 



for W with 



and with 



{(x^,y^,F^) [l,Mi]} 

2n(fl-e/2) < Ml < 2"-^ 



, Ml 

— H^"(-F/|x^y^|s) < A for all s e 

By setting ci to be the identity on [l,Mi], this code 
becomes a codecoNF(Ti, Mi, 1, Ci, 0). This is allowed because 
logAfi < nR < nCi. The encoding and decoding functions 
are defined in the obvious way. Thus the positive rate pair 
{R, 0) is achievable. ■ 

D. From Random to Deterministic 

Finally we can show that if W is not ^)- 
symmetrizable, then Ci, C2) C %(J?^, Ci, C2). To do 

so we follow Ahlswede's "Elimination Technique" [1], whose 
idea is to use random codes and to replace the randomness 
needed there by a prefix code with small blocklength which 
encodes the set of constituent deterministic codes. We again 
assume that Ci > 0. 

Theorem 17 implies that there is a < i? < Ci such that 
for any s £ (0, R) and any A G (0, 1), if n is large, there is a 
codecoNF 

{{^;,y;,F;):^G[l,n']} 



2 2 

— logn < m < logn, 

H H — S 



(19) 



with codelength pair (n^,0) and with average error smaller 
than A. Further, the conferencing function is the identity 
on the set [1, n^]. 

For any < (5 < Ci, let (i?i, E2) G ^{p, q, Ci - 6, C2) for 
some pen and aU G l^{5^). By Theorem 5, this rate pair 
is achievable with conferencing capacities C\—8 and C2 under 
random coding. For every £ > 0, A G (0, 1), and large n this 
implies the existence of a random codecoNF('^, Afi, Mi, C\ — 
5, C2) defined by a pair (C, G) such that 

-\ozM^>R^-e 
n 

and with an average error smaller than A. Again by Theorem 
5, we may further assume that the deterministic component 
codescoNF of C share the same conferencing protocol 
(ci,C2). As we do not need an exponential decrease of the 
average error, we may by Lemma 15 assume that G is 
uniformly distributed on F = [l,n^]. Let every deterministic 
component codecoNF ^(7) be given as 

{(^Jfc'yJfc>^l)^(j>^)e[l,Mi]x[l,M2]}. 

We now construct a deterministic codecoNF 

(ci, C2, /i, /2, $) with blocklength m + n, message sets 
[l,n^] X [l,Mi] and \l,Mj\ (yielding the codelength pair 
(n^Mi,M2)), conferencing capacities Ci,C2, and average 
error smaller than 2 A. It is defined via concatenation. We 
define the conferencing functions to be 

ci(7,j) := (7,ci(.7)) e X [1,^1], 

52(fc) :=C2(fc) G [l,y2]. 

Note that (ci, £2) has the form (8). It is a permissible confer- 
encing protocol if 

1 



2R-^\o^n + n 



logn < (5, 



because then 
1 



m-\-n 



log(nVi) < ^„ — log n + - log Fi < Ci . 

2it~^ logn -I- n n 

If the encoders have the messages (7, i) and fc, respectively, 
they use the codewords 

(x;,xJJ 6^"+" and (y;,yj,) G^-+". 

Together with the conferencing protocol (£1,02) defined 
above, this fixes encoding functions /i and ji, as (4) and 
(5) are satisfied. The decoding set of the codecoNF deciding 
for the pair ((7,.?),^) is defined to be F* x F]^ C ^™+". 
Thus the deterministic codecoNF achieving the rate pair {R, 0) 
is used as a prefix code which distinguishes the deterministic 
component codescoNF of the random codecoNF- In this way, 
derandomization can be seen as a two-step protocol. Setting 
a := 2/{R — e), the rates of the new code are 



m + n 



log(nM^) > 



1 



\ogM^ >R^-2e, 
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where the second inequality holds for all n large enough such 
that 

1 ^ R^-2e 



. log" 



+ 1 



> 



R,, 



The randomness of the random code is needed in the esti- 
mation of the average error incurred by this coding procedure. 
Recall Ahlswede's Innerproduct Lemma [1]: 

Lemma 18. Let (ai, . . . , ajv) and . . . , ^jv) be two vec- 
tors with < a„i, /3m < 1 for m = 1, . . . ,N which for some 
A e (0, 1) satisfy 



1 ^ 

m=l 



A, 



1 ^ 



(20) 



m=l 



then 



1 ^ 

"^rnPm > 1 " 2A. 

m=l 

We use this lenama with N = and replace the index m 
by 7 e [1, n^]. Fix an s 6 =5^" and set 



a 



7 ~ 

13.= 



w'"(^^;|x;,y;|s), 
1 



7 



Then the conditions in (20) are satisfied because both the 
deterministic prefix code (c*, C2, /*, /|, $*) and the random 
code (C, G) with constituent codes {ci,C2, fi , f] t^^) have 
an average error smaller than A. Lemma 18 now implies 
that the codecoNF (ci, C2, /i, /2, ^) constructed above has an 
average error probability smaller than 2A. 

This shows that the rate pair i?2) is achievable for #' 
with conferencing capacities Ci, C2. Consequently one obtains 

y 'rf*{y, Ci - s, C2) c Ci, C2). 

i5>0 

As the capacity region is closed, '^*(^, Ci, C2), which is 
the closure of the set on the left-hand side, is contained in 
■^^(=5^, Ci , C2) as well. This proves the direct part of Theorem 
7. 

IV. Converses for the AV-MAC with Conferencing 
Encoders 

Here we prove the converses claimed in Remark 3 
and 8. Recall that a weak converse means that, de- 
pending on the situation, any deterministic or ran- 
dom codecoNpC"-, M2, Ci, C2) such that the real two- 
dimensional vector ((1/n) logMi, (1/n) logM2) is at least 
distance £ > from the achievable rate region incurs an 
average error at least A(e) > if n is large. 

A. Random Coding 

Here we prove the weak converse for Theorem 5 (see 
Remark 3). The idea of the proof is to reduce it to the weak 
converse for the compound MAC with conferencing encoders 
defined by W where the use of random codes is allowed. This 
is proved in the Appendix. 



Every q G ^(J^)" induces a product measure via q(s) = 
q'i(si) • • • g„(s„). The notation (10) carries over to these 
general q. Further, recall the notation introduced in (6). We 
generalize this notation by setting 



The following lemma is a generalized version of Lemma 2.6.3 
in [7]. 

Lemma 19. For any random codecoNF which is defined by 
(C, G) and whose components have the form 



{(^L:yL>^7.) ■■ {3,k) e [l,Mi] X [1,M2]}, 



one has 



sup XPe(C(7)|s)pG(7) 



7er 



= sup 5^Pe(C(7)|q)PG(7)- 

Proof: The direction "<" is clear. In order to prove ">", 
let q e ^{S^Y. Clearly 

W^"(z|x,y|q) = X q(s)W"(z|x,y|s). 



Thus 



7er 



7er 

< sup XPe(C(7)|s)pG(7)- 



7er 



Upon taking the supremum over q G on the left-hand 

side, the lemma is proved. ■ 
Now let a random codecoNF {n, Mi, M2, Ci , C2) be given 
defined by (C, G) and with average error at most A. Assume 
that the pair ((1/n) logMi, (1/n) logM2) is at distance at 
least s from Ci, C2). Because of Lemma 19, 

Ao:= sup VPe(C(7)|q,)PG(7)<A. (21) 

Thus the random codecoNF (G, G) has an average error at 
most A for the compound MAC with conferencing encoders 
defined by W. But the weak converse for the compound 
MAC with conferencing encoders and random coding, which 
is proved in the Appendix, implies that (21) can only hold 
if A > Ao > A(£) > 0. This concludes the weak converse 
for the AV-MAC with conferencing encoders using random 
codescoNF, and Theorem 5 is proved. 

B. Deterministic Coding 

1) If W is {,T,^ysy)mnetrizable: If W is 
symmetrizable, then by Remark 12 it is also symmetrizable if 
considered as a single-user AVC with input alphabet ^ x 
Thus Theorem 13 implies any single -user code with at least 
two codewords incurs an average error greater than 1/4. 
Finally, note that every codecoNF for the AV-MAC with 
conferencing encoders determined by W also is a code for 
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the single-user AVC determined by W , so this carries over 
to the multi-user situation. This proves Theorem 7 if >^ is 
^^)-synametrizable. 
2) If W is not ,'3^)-symmetrizable: We show that the 
weak converse for the compound MAC determined by W 
implies the weak converse for the AV-MAC determined by 
W. Let a codecoNF {n, Mi, M2, Ci, C2) be given. If the rate 
pair ((l/n)Mi, (l/n)M2) is at least distance e away from 
Ci, C2) and if n is sufficiently large, then there is a 
q G ^{y) such that 

Y,W-{F^,\^,k,y,kM> A(e) 
j,k 

for some A(£) > because of the weak converse for the 
compound MAC. Lenraia 19 now implies that 

sfzyr, M1M2 ^ 

must hold. Thus the proof of Theorem 7 is complete. 

V. Discussion and Conclusion 

The goal of this paper was to characterize the capacity 
region of an AV-MAC whose encoders may exchange limited 
information about their messages. This topic is motivated 
by the increasing interest of cooperative networks which are 
subject to exterior interference. For example, spectrum sharing 
has been discussed for inclusion into future wireless system 
standards. We saw above that the AV-MAC can be interpreted 
as a channel suffering from attacks by an adversary who 
may choose the state sequence given the channel inputs. 
The reliability requirements for AV-MAC s are very strict - 
coding is done such that the average error is small for every 
possible state sequence. The resulting capacity region is the 
same as that for the conferencing compound MAC determined 
by the convex hull of the set of channel matrices of the 
original AV-MAC if the latter is not ^^)-symmetrizable. 
Otherwise the AV-MAC is useless. In contrast, for AV-MACs 
without conferencing, the complete characterization of the 
deterministic capacity region is still open. 

The dichotomy in the form of the deterministic capacity 
regions of arbitrarily varying multiple-access channels does 
not occur if random coding is used. However, using a random 
code requires both the senders and the receiver to have access 
to a common source of randomness. Thus random coding is 
usually only used as a mathematical tool for finding good 
deterministic codes. It is well known that derandomization 
is no problem for compound channels (including discrete 
memoryless channels as a special case) - this is nothing 
but the well-known "random coding method". It builds on 
the fact that the finite number of channel states does not 
increase with blocklength. This is not so in the case of 
arbitrarily varying channels. The number of states per channel 
use remains constant, but the number of states per transmission 
of a codeword increases exponentially in blocklength. This is 
the reason why the deterministic capacity region of arbitrarily 
varying multiple-access channels may be strictly contained in 



the random coding capacity region. In fact, if derandomization 
is not possible, then no positive rates are achievable at aU. 

In contrast to the derandomization technique used for sim- 
pler channels, Ahlswede's elimination technique gives rise to a 
two-step protocol. In order to approximate a given achievable 
rate pair (i?i,i?2), one only needs the constituent determin- 
istic codes of a random code whose rate pair approximates 
{Ri,R2). The randonmess of the random code is used in the 
average error estimate. (On the other hand, this shows how 
much weaker the average error criterion is compared with 
the maximal error requirement - the randomized part can be 
"hidden" in the average error.) 

It is noteworthy that for the arbitrarily varying multiple- 
access channel, the conferencing protocols needed to achieve 
any rate pair within the capacity region remain as simple as 
for the compound multiple-access channel with conferencing 
encoders. There are no iterative steps, so the implementation 
of such a conference is straightforward. 

Finally we would Uke to analyze the benefits of Willems 
conferencing. We compare the gains obtained in AV-MACs to 
the gains obtained in compound MACs. For both compound 
and AV-MACs, conferencing may help to achieve positive rates 
where only the rate pair (0, 0) is achievable without transmitter 
cooperation. This effect is similar to the "superactivation" of 
quantum channels as observed in [16], where it was shown 
that there are pairs of quantum channels with zero quantum 
capacity each which achieve positive rates when used together. 

Every compound MAC with conferencing capacities Ci V 
C2 > and 

max min I(Z„:X,Y)>0 (22) 

pen qe&'iJ') ^ «' ' ^ 

has an at least one-dimensional capacity region. If (22) is not 
satisfied, then the capacity region equals {(0,0)}. No matter 
what dimension the corresponding 0, 0) has, the gains 

of conferencing are continuous in Ci,C2, in particular in 
(Ci,C2) = (0,0). This is in contrast to the AV-MAC. The 
changes in in the deterministic capacity region Ci, C2) 

are continuous in all (Ci,C2) with Ci V C2 > because 
either %(J5^, Ci, C2) = 'rf*{y, Ci, C2) for all (Ci, C2) with 
Ci V C2 > or 'rfdiy,Ci,C2) = {(0,0)} for all Ci,C2. 
However, there may be a discontinuity in (Ci, C2) = (0, 0). 

This corresponds to the two roles conferencing plays in 
AV-MACs. The "traditional" role is to generate a common 
message and to use the coding result for the (compound) 
MAC with common message to enlarge the capacity region. 
For AV-MACs, it does even more - it changes the channel 
structure. Recall Remark 7. For a conferencing rate pair 
with Ci V C2 = (21ogn)/n, the capacity region of the 
compound MAC stays as it is. Under the conditions that #' is 
not ^)-symmetrizable and %(^,0,0) 7^ '^*{y,0,0), 
though, we can strictly enlarge the capacity region of the AV- 
MAC with this kind of conferencing. 

General conditions for %(J^,0,0) ^ ^*(J^,0,0) to 
hold cannot be given because an exact characterization of 
'^d(-5^)0, 0) is generally unavailable. We certainly know by 
Theorem 8 that if ^^(=^,0, 0) is two-dimensional, then 
-^^(-5^,0,0) = ^*(=5^,0,0). We can further say that if in 
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addition to not being ^)-symmetrizable, W is both - 
and ^-symmetrizable, then 0, 0) = {(0, 0)}, again by 

Theorem 8. This is a situation where already the conferencing 
from Remark 7 helps. With the same argumentation as in 
Remark 4 it can easily be seen that 

max min X, F|;7) > 0, 

so '^^*(c^,0, 0) is at least one-dimensional. Thus there is a 
discontinuity in (Ci,C2) = (0,0) in this case. Gubner [11] 
has found the example of a which is both X- and W - 
symmetrizable, but not (■^, ^)-symmetrizable. 

Example 1. Let JT = ^ = ^ = {0, 1} and ^ = {0, 1, 2, 3}. 

For s S ,5^ set 

W{z\x, y\s) = S{z — X — y — s), 

where 6{t) = 1 if < = and 6{t) = else. An equivalent 
description of this is 

z = X + y + s. 

Gubner shows that W is not ( JT, ^)-symmetrizable, but 
that it is both .9^- and ^ -symmetrizable. Thus this chan- 
nel is useless if coding is done without conferencing, even 
though the interfering signal is only added to the sum of the 
transmitters' signals - the reliable transmission of messages 
through the channel is completely prevented. This shows that 
even the structure of rather simple AV-MACs can be changed 
by conferencing so as to produce discontinuous jumps at 
(Ci,C2) = (0,0). 

Appendix 

Here we prove the weak converse for the compound MAC 
with conferencing encoders defined by W and with random 
coding. Let a random codecoNF(?i, Mi, M2, Ci, C2) be given 
which is defined by the pair (C, G). Let this code have average 
error at most A. Denote the conferencing function of the 
deterministic component codecoNF with index 7 by c-y. The 
set c-^. maps into is denoted by [1, V^]. 

We assume that the pair {{1/n) log Mi, (1/n) logM2) is at 
least distance e away from ^*(^, Ci, C2). As all norms are 
equivalent on the plane, we can without loss of generality work 
with the £^-norm. That means that we assume that 



sup 

(fli,fl2)e^*(3^,Ci,C2) 
> e. 



1 



■log Ml - Ri 



n 



logMa - i?2 



This statement is equivalent to the fact that for every p G 
n there is some q G ^(=5^) such that one of the following 
inequalities holds: 

-log Ml > Cx+I{Zq-X\Y,U)+e, 



-\ogM2>C2 + I{Zg;Y\X,U)+e, 



-\0gM1M2 
n 



(23) 
(24) 
(25) 



Our goal is to mainly use arguments already known from 
the weak converse for deterministic coding, so that we can 
refer to [17]. From the random codecoNF, we define several 
random variables in addition to G: 

• the pair (ri,T2), which is uniformly distributed on 
[1, Ml] X [1, M2] and independent of G, 

. the pair (t^i,C/2) := (cf (Ti, T2), c^(Ti, T2)) taking 
values in [l,Fi] x [1,V2], where for i/ = 1,2 we define 
Vy = max^gr VJ , 

• X := x^^y^, Y := y^^j-^, 

• a random variable Z e which satisfies 

P[Z = z|X = X, y = y, Ui=vi,U2 = V2, 

Ti=i,T2 = fc,G = 7] 
= W"(z|x,y). 

Every 7 S F corresponds to a deterministic code C{'y) with 
average error at most A^. For each of these codes, we can 
proceed as in [17]. That means that we first apply Fano's 
inequality and then obtain single-letter bounds on the code 
rates. More precisely, writing ^ = [1, n] x [1, Vi] x [1, V2], we 
can construct for each 7 a probability distribution p{u, x, y\j) 
on X ^ X which is contained in H. This is due to the 
fact proved in [19] that conditional on 7 and {Ui,U2), the 
random variables X and Y are independent. Thus we have 

p{u, X, y\j) = po{u\j)pi{x\u, 'y)p2{y\u, 7). 

Further, for each q G £P{.y), we construct the random vector 
{U, X, Y, Zq) which together with G has the distribution 



W[Zg = z,Y = y,X = x,U = u,G = ^] 
W{z\x, y\q)p{u, x, y|7)PG(7)- 



(27) 



By construction, this random vector satisfies for every q G 

- log Ml <Gi+ I{Zg; X\Y, U,G = j) + -A^, 
n n 

- logMa <C2+ liZg- Y\X, U,G = j) + -A^, 

n n 

- log M1M2 <{(Ci+C2 + nZq; X, r |[/, G = 7)) 



A/(Z,;X,F|G = 7)} + -A^, 



where 



A^ := 2h{2X^) + log M1M2. 



Next we take the expectation over G. Using the concavity of 
h and (27), this can be transformed into 

-\ogMi<Ci+I(Z„:X\Y.U,G) + -A, (28) 
n n 

-\ogM2<C2 + I{Zq;Y\X,U,G) + -A, (29) 
n n 

1 logMiM2 < {(Gi + G2 + I{Zg; X, Y\U, G)) 

A7(Zg;X,F|G)} + -A, (30) 
n 



> {G1+G2 + I{Zg; X, Y\U) A I{Z,; X, Y\U)} + e. ^j^h 

(26) 



A := 2h{2\) + 4A log M1M2. 
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As I{Zg;X,Y\G) = H{Zq\G) - H{Zq\X,Y), the concav- 
ity of entropy implies that the bound in (30) is relaxed if 
one replaces I{Zg;X,Y\G) by I{Zg;X,Y). We now set 
U := {U, G) and observe that the distribution of {U, X, Y) 
is contained in 11. Comparing the resulting set of inequalities 
with a valid one among (23)-(26) and using the same simple 
arguments as in [17], we can now show that A > A(£) > 0. 
This finishes the proof of the weak converse. 



[20] , "The discrete memoryless multiple access channel with partially 

cooperating encoders," IEEE Trans. Inf. Theory, vol. IT-29, no. 3, pp. 
441^5, 1983. 
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